Hand-held medical imaging system with improved user interface for deploying on-screen graphical tools and associated apparatuses and methods

ABSTRACT

A portable ultrasound system having an enhanced user interface is disclosed herein. In one embodiment, a portable ultrasound system can include a hand-held base unit configured to present a graphical user interface that contains a first control area, a second control area, and an active image area. The first control area can have a number of graphical tools that can each be selectively activated by a user&#39;s finger. The second control area can include a control area having plurality of controls that can be selectively activated by the user&#39;s thumb to select a tool property of a number of tool properties associated with the selected one of the graphical tools. The active image area can display an ultrasound image, and the selected one of the graphical tools can be overlaid onto the image with the user-selected tool property.

CROSS-REFERENCES TO RELATED APPLICATIONS

This application is a divisional application of U.S. patent applicationSer. No. 14/256,744, filed on Apr. 18, 2014, and entitled “HAND-HELDMEDICAL IMAGING SYSTEM WITH IMPROVED USER INTERFACE FOR DEPLOYINGON-SCREEN GRAPHICAL TOOLS AND ASSOCIATED APPARATUSES AND METHODS,” whichis hereby incorporated herein in its entirety by reference.

TECHNICAL FIELD

The disclosed technology is related to medical imaging systems, and, inparticular, some embodiments are related to portable ultrasound deviceshaving a compact form factor and a user interface that facilitateshand-held operation.

BACKGROUND

Portable ultrasound imaging devices are used by anesthesiologists,emergency and critical care personnel, and other medical professionals.A portable ultrasound device can include a clamshell-type base unithaving a handle for carrying the base unit. The base unit can fold opento a display and a keypad, and a user can connect an ultrasoundtransducer wand to the base unit to acquire and view ultrasound imageson the display.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is an isometric top view of a portable ultrasound systemconfigured in accordance with an embodiment of the disclosed technology.

FIG. 1B shows a user carrying the portable ultrasound system of FIG. 1Ain accordance with an embodiment of the disclosed technology.

FIG. 2 is a schematic diagram of various electronic components of theportable system configured in accordance with an embodiment of thedisclosed technology.

FIGS. 3A-3G show a graphical user interface presented at a touchscreenof a portable ultrasound system in accordance with several embodimentsof the disclosed technology.

FIG. 4 is a flow diagram illustrating a routine for providing on-screengraphical tools in a portable ultrasound system in accordance with anembodiment of the disclosed technology.

FIGS. 5A-5F show portable device support systems configured inaccordance with various embodiments of the disclosed technology.

DETAILED DESCRIPTION

The following disclosure describes various types of hand-held imagingsystems and associated apparatuses and methods. Certain details are setforth in the following description and FIGS. 1A-5F to provide a thoroughunderstanding of various embodiments of the disclosed technology. Otherdetails describing well-known structures and systems often associatedwith ultrasound systems, however, are not set forth below to avoidunnecessarily obscuring the description of the various embodiments ofthe disclosed technology.

Many of the details and features shown in the Figures are merelyillustrative of particular embodiments of the disclosed technology.Accordingly, other embodiments can have other details and featureswithout departing from the scope of the disclosed technology. Inaddition, those of ordinary skill in the art will understand thatfurther embodiments can be practiced without several of the detailsdescribed below. Furthermore, various embodiments of the technology caninclude structures other than those described and illustrated in theFigures. Moreover, the various elements and features illustrated in theFigures may not be drawn to scale.

In the Figures, identical reference numbers identify identical or atleast generally similar elements. To facilitate the discussion of anyparticular element, the most significant digit or digits of anyreference number refer to the Figure in which that element is firstintroduced. For example, element 110 is first introduced and discussedwith reference to FIG. 1A.

FIG. 1A is an isometric top view of a portable ultrasound imaging system100 (“portable system 100”) configured in accordance with an embodimentof the disclosed technology. Referring to FIG. 1A, the portable system100 includes an ultrasound transducer device or a transducer wand 102operably coupled to a hand-held base unit 110 (“base unit 110) by asignal cable 105. The signal cable 105 has a first end 101 a and asecond end 101 b connected between a wand port 111 of the base unit 110and a proximal end portion 103 a of the transducer wand 102. In someembodiments, the signal cable 105 can include a connector or plug at thesecond end 101 b (not shown) configured to removably couple the signalcable 105 to the transducer wand 102.

The transducer wand 102 includes a housing 104 (e.g., a molded plastichousing) extending from the proximal end portion 103 a to a distal endportion 103 b. The housing 104 includes a scan head region 106 thatencloses a transducer array (not shown) within the housing 104 towardthe distal end portion 103 b. In some embodiments, the transducer wand102 can include one or more buttons, triggers, or other input devices(not shown) configured, for example, to toggle power on or off, put theportable system 100 in a standby state, or to perform other operations.In other embodiments, the transducer wand 102 can include, for example,light-emitting elements that visually indicate an operational state ofthe transducer wand 102, a housing having a different shape and/or size,and/or other configurations or features.

In the illustrated embodiment, the base unit 110 includes a casing 112(e.g., a plastic and/or metallic casing) and a touchscreen display 114(“touchscreen 114”) attached to the casing 112. The touchscreen 114 hasa touchscreen surface 118 with transparent electrodes (e.g., indium tinoxide electrodes; not shown) in a capacitive configuration for sensingskin or stylus contact with the touchscreen surface 118. In anotherembodiment, the touchscreen surface 118 can include electrodes in aresistive configuration configured to sense pressure contact (ratherthan skin contact). In one aspect of this embodiment, a resistiveconfiguration can enable a user to operate the touchscreen 114 with agloved hand (e.g., a latex-gloved hand). The base unit 110 can alsoinclude user controls 113 a and input/output (I/O) ports 113 b at anouter edge of the base unit 110. The controls 113 a can include, forexample, buttons, knobs, switches, etc. The I/O ports 113 b can include,for example, audio, universal serial bus (USB), high-definitionmultimedia interface (HDMI) ports), etc.

FIG. 1B shows a user carrying the portable system 100 in accordance withan embodiment of the disclosed technology. In use, a physician orultrasound technician can use the transducer wand 102 and the base unit110 to perform an ultrasound scan. In particular, the user can place thetransducer wand 102 toward a target region of interest within a patient(e.g., an organ and/or an internal cavity), and the base unit 110displays an image on the touchscreen 114 (FIG. 1A) based on theultrasound scan. In one aspect of this embodiment, a user can use onehand (e.g., the right hand) to operate the transducer wand 102 andsimultaneously use the other hand (e.g., the left hand) to carry andoperate the base unit 110. In one embodiment described in greater detailbelow with reference to FIGS. 3A-3G, the touchscreen 114 can include agraphical thumb controller (not visible in FIG. 1B) configured tocontrol the base unit 110. In another embodiment described in greaterdetail below with reference to FIG. 5, the portably system can include aharness, belt, or other wearable feature that allow a user to operatethe system while simultaneously carrying it on their person.

FIG. 2 is a schematic diagram of various electronic components of theportable system 100 configured in accordance with an embodiment of thedisclosed technology. Referring first to FIG. 2, the portable system 100includes transducer electronics 230 at the transducer wand 102 (FIG. 1A)and base-unit electronics 240 at the base unit 110 (FIG. 1A). Thetransducer electronics 230 can drive a transducer array 232, such as anarray of microelectromechanical transducer elements, located at the scanhead region 106 (FIG. 1A). The transducer electronics 230 can alsoinclude one or more driver circuits 233 configured to operate thetransducer array 232. The driver circuits 233 can include, for example,waveform generators 235, amplifiers 236, analog to digital converts(ADCs) 238, and other ultrasound signal processing components (e.g., aCPU, controller, transmit/receive beam former circuitry, etc.). In someembodiments, at least a portion of the driver circuits 233 can belocated at the base unit 110.

The base-unit electronics 240 include a CPU 242, input/out devices 243,and communication components 245. The CPU 242 includes a programmableprocessor 249 configured to execute instructions in memory 248 in orderto perform various processes, logic flows, and routines. The input/outdevices 243 can include, for example, the touchscreen 114, a camera 226,a microphone 227, and/or a speaker 228. The communication components 245can include, for example, signal buses coupled to the wand port 111, theinput controls 113 a, the communication ports 113 b, and the touchscreen114. In several embodiments, the communication components 245 canfurther include a network adaptor, a wireless transceiver (e.g., Wi-Fior cellular transceiver), or other suitable components for communicationover the Internet, a computer network, and/or a wireless network.

In operation, the driver circuits 233 can operate the transducer array232 to produce and steer an acoustic signal toward a target region ofinterest. The base-unit electronics 240, in turn, can drive the drivercircuits 233 based on user input. For example, as described in greaterdetail below, the user can provide input by operating various graphicalcontrols presented at the touchscreen 114. The driver circuits 233 canalso produce information based on the acoustic signals returned to thetransducer array 232, which the base-unit electronics 240 uses todisplay ultrasound images on the touchscreen 114 as the information isacquired.

FIGS. 3A-3G show a graphical user interface 350 presented at thetouchscreen 114 (FIG. 1A) in various display states in accordance withseveral embodiments of the disclosed technology. Referring first to FIG.3A, the graphical user interface 350 includes an active image area 352in which an ultrasound image is displayed, a status bar 353 (indicatingthe current time, a wireless signal strength, battery lifetime, etc.),and three control areas 355 a-c (shown in silhouette form in FIG. 3A).In use, the control areas 355 can be expanded from a retracted state (asshown) such that they overlay portions of the active image area 352. Forexample, in several embodiments the user can slide a finger across thetouchscreen 114 in the general directions shown by arrows A-C toexpand/contract the three control areas 355 a-c, respectively. Asdescribed in greater detail below, when expanded, the control areas 355can present various graphical tools (e.g., markers, labels, calipers,etc.) that the user can position or overlay onto the active image area352 (e.g., by dragging the graphical tool onto the active image area352). In some embodiments, the control areas 355 can automaticallyretract if the user does not touch or access the selected control areafor a certain period of time (e.g., within several seconds of nottouching the selected control area).

FIG. 3B shows the graphical user interface 350 in a configuration inwhich the user has expanded the third control area 355 c. As shown, thethird control area 355 c includes touch-selectable features, or softbuttons, corresponding to a number of graphical tools the user canoverlay or implement on an ultrasound image or a series of ultrasoundimages displayed at the active image area 352. In general, suchgraphical tools can identify, label, measure, or otherwise help a userevaluate an ultrasound image. For example, the “MARKER” and “PICTO” softbuttons can be selected to overlay a graphical marker or a pictograph,respectively, on the ultrasound image, the “CALIPER” soft button can beselected to measure a distance between objects captured in theultrasound image, and the “WINDOW” soft button tool can be selected bythe user to zoom and/or pan the image.

FIG. 3C shows the graphical user interface 350 in a configuration inwhich the user has selected the “PICTO” soft button in the thumbwheel357. In response to this selection, the processor opens the firstcontrol area 355 a. As shown, the first control area 355 a includes athumbwheel 357, soft button controls 358 a that are on the thumbwheel357, and one or more other soft button controls 358 b that are off thethumbwheel 357. In one aspect of this embodiment, the soft buttoncontrols 358 a on the thumbwheel 357 enable users to select a toolattribute or tool property of the selected graphical tool, such as itsvisual or graphical appearance. For example, when the user selects the“PICTO” button, the soft buttons 358 a on the thumbwheel 357 eachcorrespond to a graphical icon representing an anatomical location(e.g., a torso region, a head region, a left-arm region, etc.). Also,the user can select the “Front” or “Back” icons to further indicate fromwhich side of the patient the ultrasound image was acquired. In anotherembodiment, the touch-selectable controls can be selected to performother functions. For example, the “SCAN” soft button can be selected toinitiate an ultrasound scan. In these and other embodiments, thetouch-selectable controls can include controls described, for example,in co-pending U.S. patent application Ser. No. 14/256,759, titled“Hand-Held Medical Imaging System with Thumb Controller and AssociatedApparatuses and Methods”, filed concurrently herewith and incorporatedherein in its entirety by reference. In another embodiment, the controlarea 368 includes touch-selectable features that do not modifyultrasound scanning parameters. For example, the user can select the“Marker” soft button to position a graphical marker on the ultrasoundimage.

Upon selecting a tool property from the thumbwheel 357, the user canposition (e.g., slide or drag) the pictograph on the active image area352 (as shown by arrow D). For example, in the illustrated embodimentthe user has dragged the pictograph representing the human torso ontothe active image area 352. In one aspect of this embodiment, thethumbwheel 357 allows the user to access other soft buttons not in viewon the touchscreen 114. For example, users can use their thumb to sweepover the soft buttons displayed in order to rotate the thumbwheel 357 inthe clockwise direction (as shown, e.g., by Arrow E) to hide one or moreof the displayed soft buttons and bring other soft buttons into view. Inanother embodiment, users can rotate the thumbwheel 357 by touching thethumbwheel 357 at its outer edge or periphery (i.e., via the touchscreen114) and then spinning the thumbwheel 357 until a desired soft buttoncomes into view.

FIG. 3D shows the graphical user interface 350 in a configuration inwhich the user has selected the “Organs” button within the first controlregion 355 a. In response, the thumbwheel 357 has presentedtouch-selectable icons that each represent an organ within the humanbody. In the illustrated embodiment, the user has selected an iconrepresenting the lower intestinal tract and dragged this icon (as shownby arrow G) onto the human torso icon previously place on the activeimage area 352. In one aspect of this embodiment, users can dynamicallyselect the display state of the selected pictograph with their thumbusing the thumbwheel 357 while simultaneously dragging a pictograph ontothe active image area 352 with their finger. For example, as shown inFIG. 3D, the user initially selected the brain icon from the thumbwheel357. As the user dragged the brain icon from the thumbwheel to locationL1 on the path of the arrow G, the user simultaneously operated thethumbwheel 357 such that by the time the user's finger reached locationL2, the icon representing the lower intestinal tract was displayed onthe active image area 352.

FIG. 3E shows the graphical user interface 350 in a configuration inwhich the user has selected the “Marker” button within the third controlarea 355 c. In response to selecting the “Marker” button, the processorhas displayed various graphical markers in the second control area 355b. In particular, the processor has displayed textual markers 351 and anarrow marker 354 that the user can drag onto the image at the activeimage area 352. As shown, the user has selected a “Date/Stamp” icon anddragged this icon from the second control area 355 b onto the image atthe active image area 352. The user can also select a “Text” icon toselect a textual marker that allows the user to annotate text onto theimage (e.g., via a pop-up graphical keyboard; not shown). In yet anotherembodiment, the textual marker can include a textual label selected froma library of labels (not shown) corresponding to, e.g., a particularportion of the anatomy or a pathology.

FIG. 3F shows the graphical user interface 350 in a configuration inwhich the user has selected the “Window” button in the third controlarea 355 c. As shown, the processor has presented a window 361 on theimage at the active image area 352 and a track pad 359 in the firstcontrol area 355 a. In one aspect of this embodiment, the user can usethe track pad 359 to move the window 361 to various locations on theactive image area 352. For example, a user can swipe a finger or thumbfrom location L3 to location L4 on the track pad to move the window 361in the direction of arrow F on the active image area 352. In someembodiments, the user can make certain swiping gestures with the thumbor finger across the track pad 359 to zoom into an image or, conversely,to zoom away from an image. For example, in one embodiment a generallyinward pinching motion can zoom into an image. In another embodiment,the track pad 359 can also enable fine grain placement of a graphicaltool. For example, a user may use the track pad 359 for fine grainplacement of the arrow graphical marker 354 shown in FIG. 3E.

FIG. 3G shows the graphical user interface 350 in a configuration inwhich the user has selected to overlay a graphical caliper tool 368 onthe ultrasound image. As shown, the user has selected the “Caliper” softbutton of the third control area 355 c. The processor then produces adisplay of a measurement (e.g., 1.0 cm) between a pair of endpoints 363,365. If the user touches the display near either endpoint, the processorproduces a handle 366 that is connected by a dotted line to the nearestendpoint that was touched. Then user can than move endpoint by draggingthe handle 366 in the direction where the endpoint is to move. In oneaspect of this embodiment, the user can use the graphical handle 366 tochange the location of the end point 363 on the active image area 352(e.g., by dragging the graphical handle 366 to a different location onthe active image area 352). As the user changes the location, themeasurement taken by the caliper tool 368 changes based on the newposition of the end point 363 relative to the other endpoint 365 of thecaliper tool 368. In another aspect of this embodiment, the graphicalhandle 366 is displayed such that it is offset from the endpoint 363. Assuch, the user's fingertip does not obscure the user's view of theendpoint 363 while operating the graphical caliper tool 368.

FIG. 4 is a flow diagram illustrating a routine 470 for providingon-screen graphical tools in a portable ultrasound system in accordancewith an embodiment of the disclosed technology. The routine 470 beginsat block 471 by displaying an ultrasound image in the active image area352 as well as any control areas 355 and/or graphical tools that havebeen previously selected by the user. The routine 470 can also displayuser-selectable tool properties associated with a particular one of thegraphical tools (e.g., anatomical locations to be represented by apictograph). Upon displaying the active image area 352 and anyuser-selected graphical tools, the routine 470 proceeds to block 472 todetect whether the user has operated a graphical tool (e.g., by dragginga pictograph from the third control area 355 c onto the active imagearea 352 with the user's index finger). At the same time, the routine472 can also proceed to block 473 to detect whether the user hasselected a tool property (e.g., by selecting a pictograph attribute withthe user's thumb).

At block 472, the routine 470 detects whether a user has operated agraphical tool. For example, the routine 470 can detect whether a userhas selected the “PICTO” soft button to place a pictograph on the activeimage area 352. The routine 470 also detects any movement associatedwith the selected graphical tool. For example, the routine 470 candetect whether the user has dragged a graphical tool from the thirdcontrol area 355 c and onto the active image area 352. The routine 470can also detect movement or motion on the track pad 359 for placement orpositioning of a window, a marker, a caliper, or other tool. If theroutine 470 has detected the operation of the graphical tool, theroutine 470 proceeds to block 474 to modify the display of the graphicaltool based on the detected selection and/or motion associated with thegraphical tool before returning again to block 471. Otherwise, theroutine 470 can proceed directly to block 471 to continue displaying theultrasound image and any graphical tools previously selected by theuser.

At block 473, the routine 470 detects whether the user has selected atool property. For example, the routine can detect whether the user hasrotated the thumbwheel 357 and/or selected a control on the thumbwheel357 corresponding to a particular tool property. In several embodiments,the user can modify the tool property at the same as the user isoperating the graphical tool at block 472. For example, the routine candetect operation of the thumbwheel 357 at the same time that the user ismoving a graphical marker onto the active image area 352, as discussedabove. Once the routine 470 has detected the selection of a toolproperty, the routine 470 proceeds to block 475 to display the graphicaltool with the selected tool property before returning again to block471. Otherwise, the routine 470 proceeds directly to block 471 tocontinuing displaying the ultrasound image and any graphical toolspreviously selected by the user.

As discussed above, in several embodiments, the user can employ awearable support system that allows users to carry the portable system100 directly on their person. For example, FIGS. 5A-5F show portabledevice support systems configured in various embodiments of thedisclosed technology. Referring to FIGS. 5A-25, in several embodiments asupport system 590 a (FIG. 5A) can include a belt 592 that allows theuser to carry the base unit 110 at the user's waist. In someembodiments, a support system 590 b (FIG. 5B) can include a sling 593that supports the weight of the base unit 110 over the user's shoulderand at the user's waist. In one aspect of this embodiment, the sling 593has loops 594, eyelets, or other features through which the signal cable105 can be routed on the sling 593, over the user's shoulder, and aroundthe user's neck. As shown, this allows the user to drape the signalcable 105 over the other shoulder for carrying the transducer wand 102when not in use. In another embodiment, a support system 590 c (FIG. 5C)can include a harness 596 that the user can carry on their shouldersand/or neck. In one aspect of this embodiment, the harness 596 can holdthe base unit 110 at a viewing angle that allows users to view thedisplay on base unit 110 without having to hold the base unit 110 withtheir hand.

Referring to FIGS. 5D-5F, in one embodiment a support system 590 d (FIG.5D) can include a holster 591 (e.g., a hard-plastic protective holster)carried by a sling 597. As shown, the sling 597 can include individualpockets or compartments 598 for storing components, such as sparebatteries and/or the transducer wand 102. In certain embodiments, asupport system 590 e (FIG. 5E) can include attachment features 525(e.g., clips, snaps, etc.) that can attach the base unit 110 to a user'ssleeve or a wrist band (not shown). In one embodiment, a support system550 f (FIG. 5F) can include a foldable platform 599 formed from, e.g., arigid plastic material, reinforced leather, or other suitable materialthat can attach to a backside surface 524 of the base unit 110. In oneaspect of this embodiment, the foldable platform 599 can include a panel529 that attaches to a user's clothing via attachment features 521, suchas a hook/loop type of fastener, magnets, or the like. Similar to theharness 596 (FIG. 5C), the foldable platform 599 includes an angledsupport that holds the base unit 110 at a viewing angle that allowsusers to view the display on base unit 110 without having to hold thebase unit 110 with their hand.

From the foregoing, it will be appreciated that specific embodiments ofthe disclosed technology have been described herein for purposes ofillustration, but that various modifications may be made withoutdeviating from the scope of the various embodiments of the disclosedtechnology. Moreover, because many of the basic structures and functionsof transducer arrays, transducer electronics, and other processorelectronics are known, they have not been shown or described in furtherdetail to avoid unnecessarily obscuring the described embodiments.Further, while various advantages and features associated with certainembodiments of the disclosed technology have been described above in thecontext of those embodiments, other embodiments may also exhibit suchadvantages and/or features, and not all embodiments need necessarilyexhibit such advantages and/or features to fall within the scope of thedisclosed technology.

1. A method executed by a processor to overly graphical tools onultrasound images in a portable ultrasound system, the methodcomprising: performing an ultrasound scan with a transducer device and abase unit operably coupled to the transducer device, wherein the baseunit includes a touch-screen display; displaying an image on an activeimage area of the touchscreen display based on the ultrasound scan;displaying a first control area on the touchscreen display having aplurality of graphical tools that can be selectively activated by auser's finger; detecting a selection of a graphical tool from theplurality of graphical tools; displaying a second control area;displaying a plurality of controls in the second control area based onthe detected selection of the graphical tool, wherein the plurality ofcontrols can be selectively activated by a user's thumb when holding thebase unit to select a tool property of a number of tool properties;detecting a selection of a control from the plurality of controls; andoverlaying onto the image the selected one of the graphical tools withthe selected one of the tool properties.
 2. The portable ultrasoundsystem of claim 1 wherein: the selected one of the graphical tools is apictograph; and the tool properties each correspond to a graphicalrepresentations of a region of the human anatomy.